Maximal— entropy random walks in complex networks with limited information 
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Maximization of the entropy rate is an important issue to design diffusion processes aiming at a 
well-mixed state. We demonstrate that it is possible to construct maximal-entropy random walks 
with only local information on the graph structure. In particular, we show that an almost maximal- 
entropy random walk is obtained when the step probabilities are proportional to a power of the 
degree of the target node, with an exponent a that depends on the degree-degree correlations, and 
is equal to 1 in uncorrelated graphs. 
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In the last decade an increasing attention has been de- 
voted to the study of random walks on complex topolo- 
gies [l|,0. Various features of random walks on networks, 
such as passage times 043 and spectral properties 0, Q 
have been investigated, and random walks have also been 
used to detect communities [Sljlsl , to evaluate centrality of 
nodes [3|, |lO|, lll| and to coarse-grain graphs [6| . Another 
quantity recently considered is the entropy rate, a mea- 
sure to characterize the mixing properties of a stochastic 
process [12[. In particular, attention has been focused on 
designing random walks with maximal entropy rate on a 
given graph 13Ml7l| , i.e. choosing the transition probabil- 
ities of the random walk in such a way that the random 
walkers are maximally dispersing in the graph, explor- 
ing every possible walk with equal probability. Practical 
examples where the maximization of entropy rate is im- 
portant are diffusion processes which aim at well-mixing, 
such as spreading information about a node's state (its 
healthy or infected condition, its availability or conges- 
tion, etc.) [l7|, mixing in meta-populations models [18|, 
or global s ync hronization of moving agents by local en- 
trainment [19[. 

In principle, the optimization of entropy rate could re- 
quire the definition of transition probabilities relying on 
the history of the walker's positions. However, it has been 
proven that allowing a long-term memory of the past is 
not needed in order to construct maximal-entropy ran- 
dom walks, since it turns out that there always exists an 
optimal set of transition probabilities that is Markovian 
13l4l6j. Namely, the maximum entropy rate is obtained 
with a Markov random walk in which the probability to 
step from node i to node j is equal to '^ ^ , where A is 
the largest eigenvalue of the adjacency matrix A = {ojA 



of the graph, and u is the associated eigenvector [If 
The corresponding value of the maximum entropy rate is 
equal to In A. This random walk process has the inter- 
esting property to be biased, in the sense that a walker 



follows a link (i,j) with a probability proportional to 
the importance of its end j, as measured by its eigen- 
vector centrality Uj [20[. However, the main problem 
with a real implementation is that, at each time step, 
the walker needs to have a global knowledge of the net- 
work: it needs to know the adjacency matrix of the entire 
graph. Such global information is very often unavailable. 
A walker at a node i usually has only a local information, 
in the sense that it knows the first neighbors of node i, 
and possibly some of their topological properties, such 
as their degree [17| . In this paper, we prove that almost 
maximal-entropy random walks can indeed be obtained 
with a limited and local knowledge of the network. We 
show how to construct them by solely using the degrees 
of first and second neighbors of the current node. 

Let us consider a Markov random walker moving from 
node to node on a connected, undirected and unweighted 
graph with N nodes and K links. At each time step, 
the walker moves from the current node to one of its 
neighbors. If we indicate as 7r(j|i) the probability of 
jumping from i to j (with the normalization condition 
E,^(jN) = 1 Vi), then 7r(j|t) ^ iff ay = 1, i.e. if 
and only if j belongs to the neighborhood of i, Ni- We 
assume that the walker has the freedom to select the first 
neighbors of i with different probabilities, so that not all 
nodes in Mi are equally selected and some of them are 
preferred to the others. The simplest case to consider is 
that of a regular graph, i.e. a graph in which all nodes 
have the same degree. The graph can be a random regu- 
lar graph, or a regular lattice. In such a case, since all the 
first neighbors of a node are equivalent, the best choice 
is to set 7r(j|z) = ay/X^i^yi i-^- to select one of the 
nodes in A/i at random with uniform probability. Things 
are different in graphs where the nodes have different 
degrees, especially in graphs with highly heterogeneous 
degree distributions. As we will show below, in these 
cases, maximally-random walks on a graph can be also 



obtained with only a limited and local knowledge of the 
topology of the graph. 

The optimal random walk on a given graph can be 
rigorously determined on mathematical grounds by con- 
sidering the entropy rate h of the stochastic processes 
associated to different random walks [1^. A trajectory 
of t steps generated by a random walk starting at a fixed 
node i is described by the sequence of occupied nodes 
I, ii, i2, . . . , it, where zi,..., it are all indices that can take 
integer values between 1 and N. This means that the 
walker first moves from i to node zi, then it jumps to 
node Z2 and so on. In practice, there is a maximum 
of M{t) different allowed sequences of length t, corre- 
sponding to all possible walks of length t (and starting 
at node i) on the graph under study. Depending on the 
rules of the random walk, not all possible sequences will 
appear, while some of them will occur with a probabil- 
ity higher than the others. If we denote as joint proba- 
bility p{i,ii,i2, ■ ■ ■ ,it) the probability that the sequence 
1,11,12,- ■■ , it is generated by a given random walk, then 
the entropy rate of the random walk, h, is defined as: 



lim — , 



(1) 



where St is the Shannon entropy of the set of tra- 
jectories of length t starting at node i: St ~ 
-Eii,j2,...,jt-P(«'«i'---i«t)lnp(«, *!,•■•, it)- The mini- 
mum possible value of the entropy rate, ft-min — 0, is 
obtained when, for large time t, only one trajectory 
dominates. On the other hand, the maximum possible 
value is obtained when, for large time t, all the M{t) 
allowed trajectories have equal probability to occur, i.e. 
p{i, «!,..., it) = 1/M{t) a i,ii, . . . ,it is a walk on the 
graph originating in i, and p{i,ii, . . . ,it) = other- 
wise. The maximum value of the entropy is equal to: 
^max = limt-i-oo — t • Now, in the most general case, the 
probability of having a sequence of t nodes originating at 
a given node i can be written (for any i > 1) in terms of 
conditional probabilities as: 

p{i,ii, ...,it)= p{ii\i)p{i2\hH) ■ ■ ■p(«t|i,«i, ■ • ■,H~i)- 

Summing both ends over 12, 13, . . . , it, and using the nor- 
malization conditions ^^^ p(zt|i,ii,i2, . • . , it-i) = 1 for 
t > 2, we get an expression for the conditional proba- 
bility at the first step as a function of the t-times joint 
probabilities: 
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This means that, no matter how long is the me- 
mory in the random walker, we can always describe 
it as a Markov random walker, provided that we de- 
fine the transition matrix of the Markov chain 7r(ii|z) 
in terms of the joint probabilities p{i,ii, . . . ,it) as in 
Eq.([2]). In particular, if we want to construct a maximal- 
entropy random walk, we have to set p{i, ii, 12, . . . , it) = 



\/M{t) iff i,ii,i2, ■ ■ ■ ,it is a walk on the graph, and 
p{i, ii,i2, . ■ ■ ,it) — otherwise. The number of walks of 
length t originating in i can be written in terms of the ad- 
jacency matrix as: M{t) = J2h,i2,...,it «"i"ni2 ■ ■■au_iu- 
Hence, the joint probability of a trajectory i,ii,i2, ■ ■ ■ ,it 
reads: 



p{i,ii,...,it) 



^iii ^i\i2 



, (3) 



and the transition matrix of the Markov random walker 
with the maximal entropy is finally given by: 

O-ii-i 2-112 ^i-i-i^ ■ • ■ ^it ^«t-i 



7r(zi|i) — lim 



(4) 
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The value of the entropy rate in Eq. ([T]) can then be cal- 
culated directly from matrix tt, as for any crgodic Markov 
chain, from [13: 



h^ -^7r(j|i) •u'*(i)ln[7r(j|i)] 



(5) 
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where w*{i) is the i*'' component of the stationary 
distribution. From Eq. (0]) it is clear that, in the most 
general case, in order for a walker at a node i to select 
one of its first neighbors to step on, the walker needs 
to know not only which node is in A/i, but also the 
neighborhood of first neighbors, the neighborhood of 
second neighbors, and so on. In practice, the local 
choice of moving from i to one particular neighbor ii, 
depends on the whole adjacency matrix of the graph. 
However, as we demonstrate below, this global informa- 
tion is not necessary in most of the cases. Uncorrelated 
networks.- Uncorrelated graphs can be described by 
the degree sequence of the nodes {k{l), k{2), . . . , k{N)}, 
corresponding to a degree distribution Pfc, since the 
degree of a node does not depend on the degree of its 
first neighbors. In mathematical terms, this means that 
the conditional probability Pk'\k does not depend on k, 
and can be written in terms of the degree distribution 
as: P^nl ~ k'Pk'/{k) where the right hand side is 
the probability to end up in a node of degree k' by 
choosing an edge at random with uniform probability. 
Consequently, the average degree of the neighbors of 
node j, knnU) = 1/^0) S; "^i'^COi does not depend 
on the degree of j, knnij) = knn Vj, and the last two 
summations in the numerator and in the denominator of 



Eq. dl), namely Ei,_ a^t-ait-s Ei 
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k{it-2)knn{it-2) Can be written as 



^nn Z^it_2 "'it-3it-2^(*t-2)- 



The constant fc„„ at the 
numerator and at the denominator cancels out, so that 
the same argument can be repeated again and again. 
Finally, the formula factorizes into: 

au^k{ii) 



^\^l\^) 



(6) 



where, by the symbol tt^ we mean the first order ap- 
proximation to the transition matrix -k in Eq. ^. This 



formula tells us that the best diffusion process on a uncor- 
related graph is a random walk whose motion is linearly 
biased on node degrees. Thus, a walker at a given node, 
only needs to have information on its first neighbors and 
their degree. Since the degrees of different nodes are not 
correlated, local information of the degree of first neigh- 
bors is, in this case sufficient to construct the diffusion 
process with maximal entropy. Such information is "lo- 
cally available" to the walkers, meaning that a walker at 
node i has complete information on the degree of each 
node in its neighborhood Ni . Now, it is intuitive that a 
random walk choosing a node j proportionally to fc(j), so 
that all the trajectories of length 2 starting in i will occur 
with the same probability, will be more random than a 
walker selecting uniformly the first neighbors of i. 

Formula © gives theoretical grounds to the results of 
Ref. [ITJ l , where random walks with power law dependence 
7r(ii|i) oc k°'(ii) were explored as a function of a (a > 
indicates a bias toward high-fc neighbors, while a < 
means preferring low-fc nodes), and it was numerically 
found indication of a = f as the best value of a if the 
graph is uncorrelated. Of course, if all nodes have the 
same degree, as in a regular graph, the transition matrix 
reduces to that of an unbiased walker: 



^°(*i|*) = 



L-iii '^iil 



(7) 



This is the lowest possible approximation for n in Eq. Q : 
in the case of no available information, each neighbor has 
the same probability to be selected. The values of h ob- 
tained numerically with transition matrices tt" and tt^ in 
different models of uncorrelated networks are reported in 
Table HI In agreement with our predictions, in regular 
lattices and in random regular graphs, h{Tr'^) is equal to 
the maximal possible entropy /imax = hi A. In Erdos- 
Renyi (ER) random graphs not all nodes have the same 
degree, so that a random walk linearly biased on degree 
has an entropy h{Tr^) that is much closer to the maxi- 
mum, than hijr'^). This effect is even more evident in 
scale- free graphs, i.e. in graphs with a very heteroge- 
neous degree distribution. 

Networks with degree- degree correlations.- Graphs with 
degree-degree correlations are described in terms of their 
degree distribution P^, and of a non-trivial Pk'\k- This is 
because the probability that a link from a node of degree 
k arrives at a node of degree k' does not simply factorize 
in terms of the degree distribution. In such graphs the 
average degree of the first neighbors of a node j, knn{j), 
does depend on k(j). Therefore, in analogy with Eq. (|6]) 
we can define a second order approximation of Eq. (P|): 
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h(7r) 






ftmax = h{TT) 


Regular lattice 


1.000 


1.000 


1.000 


1.79 


Random regular graph 


1.000 


1.000 


1.000 


1.79 


ER random graph 


0.954 


0.993 


0.998 


1.98 


Uncorr. scale-free 7 = 1.5 


0.886 


0.992 


0.996 


2.36 


BA model 


0.825 


0.976 


0.996 


2.52 


Assort, scale- free 7 = 1.5 


0.876 


0.991 


0.999 


2.44 


Disassort. scale-free 7 = 1.5 


0.937 


0.990 


0.997 


2.18 


Regular lattice (1% defects) 


0.996 


0.997 


0.998 


1.38 


Regular lattice (10% defects) 


0.967 


0.978 


0.981 


1.34 


Regular lattice (20% defects) 


0.931 


0.955 


0.963 


1.29 


Internet AS [211 


0.744 


0.900 


0.980 


4.10 


US Airports [IS] 


0.879 


0.990 


0.997 


3.88 


E-Mail [22] 


0.881 


0.983 


0.997 


3.03 


SCN (cond-mat)[23j 


0.694 


0.867 


0.946 


3.17 


SCN (astro-ph) [23] 


0.784 


0.941 


0.973 


4.41 


PGP [24] 


0.597 


0.92 


0.976 


3.75 



TABLE I. The entropies of random walks with no informa- 
tion, h[-K^), and with local information respectively on near- 
est, h{-K^), and next-nearest neighbors, h{'jT^), are compared 
to the maximal possible entropy /imax ~ h{Tr) = In A on differ- 
ent graph models with A'^ = 500 and average degree (fc) — 6, 
on A^ = 40 X 40 regular square lattices with defects (see [27 
and on various real networks. 



describing a Markov walker that, at each time step, se- 
lects a first neighbor, ii, of the current node, with a prob- 
ability proportional to the sum of the degrees of the first 
neighbors of ii. This is equivalent to make equiprobale 
all the walks of length 3 originating in i. In conclusion, 
to construct high-entropy random walks on correlated 
graphs, a walker at a given node needs to know the de- 
gree of first and second neighbors of the current node, 
which is still local information. 

In Table Uwc report h{Tr'^) for various models and for 
real networks. In models of uncorrelated graphs h{TT^) is 
not very different from h^ir^), while in models of corre- 
lated graphs, in lattices with defects and in most of the 
networks from the real world h^n'^) is a much better ap- 
proximation of /i(7r) than h{TT^). In most real-world net- 
works, degree-degree correlations are such that the aver- 
age degree of the first neighbors of a node exhibits a clear 
power-law dependence on degree: knn{j) ~ [^(i)]~''j 
with ly > {i^ < 0) for disassortative (assortative) net- 
works [21 • For instance, as shown in the inset of Fig. [U 
1/ ~ 0.4 for the Internet at the autonomous systems level 
2l|. Plugging this dependence in Eq. ([H]), we get an ap- 
proximate form for the maximal-entropy random walk 
in a correlated random graph in terms of degree-biased 
random walks: 



7TH^l\^) 



aihlkjii)]'^ 



(9) 



In practice, on a correlated network, an approximation 
for the maximal-entropy random walk can be obtained 
by considering a random walk whose motion is biased 
as a power of the target node degree, with an exponent 
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FIG. 1. Entropy rate of power-law biased random walks as a 
function of the degree exponent a for Internet AS. Horizontal 
lines correspond to, from bottom to top, h{-K^), h{Tv^), h('jT^) 
and /imax ~ hiji). (Inset) Average degree fc„„ of the first 
neighbors of nodes of degree k, as a function of k, with fit 
k-°\ 



the node [20[, and it is indeed the same transition ma- 
trix proposed in [16| as the process with the maximum 
possible entropy rate /imax = In A ISHlGf . 

In order to perform a maximal-entropy Markov walk on 
a graph, at each time step, a walker needs a global knowl- 
edge of the whole network and has to compute u, which 
has 0{K) computational complexity. However, global 
information is in practice always unavailable in real sys- 
tems. As we have shown in this paper, this global knowl- 
edge is not necessary since in many real-world networks 
long-range interactions are weak and can be neglected. It 
is therefore possible to construct almost maximal-entropy 
random walks with only local information on the graph 
structure. This can be done with 0{{k)) complexity, a 
dramatic improvement which opens up to practical ap- 
plications in social, biological and technological systems. 



a = l — iy. Hence, the optimal bias aopt is larger (smaller) 
than 1 for assortative (disassortative) networks, meaning 
that we have to prefer a super-linear (sub-linear) bias on 
the node degree. As an example, in Fig. [T] we report the 
entropy rate of a biased random walk as a function of the 
exponent a on a disassortative real-world network. We 
found aopt = 0.6 for Internet AS, which is perfectly in 
agreement with the value v = 0.4 in the inset, through 



the relation i 



^opt 



1 — v. We have also checked that this 



relation holds for the other real networks in Table ID 

Networks with higher-order degree- correlations.- Simi- 
lar arguments can be repeated for networks with higher- 
order correlations. This procedure generates a class of 
biased random walks defined by the transition matrices 
tt", tt^, tt^, etc, incorporating more and more information 
about the system structure. In Supplementary Material 
we studied how this sequence of transition matrices con- 
verges to TT in different networks. In the limit case in 
which a graph has correlations at all orders, we have 
to rely on the full transition matrix of Eq. (|4]), which 
can be also expressed by means of the eigenvalues and 
eigenvectors of the adjacency matrix of the graph. In 
fact, the numerator and the denominator of ^ can be 
rewritten in terms of powers of the adjacency matrix, 
respectively as au^ I]it(^*~^)nJt = a^^^{A^-'^ ■ 1)^^ and 
Y.H (^*)"t = (^* • l)i; where {A^)ij indicate the entry i,j 
of matrix A^ , and 1 is a vector of ones. By making use 
of the power method for f — > oo, we finally get: 



7r(ii|i) 



Xui 



^ii-\ ""/ 



E,a 



j "y "j 



(10) 



where A and vector u are respectively the largest eigen- 
value and its associated eigenvector of the adjacency ma- 
trix 25| . Eq. ([TU| represents a Markov walk whose tran- 
sition probability is linearly biased by the components of 
eigenvector u, also known as the eigenvector centrality of 



[I] P. Blanchard, D. Volchenkov, Random Walks and Diffu- 
sions on Graphs and Databases, Springer (2011). 

[2] S. Boccaletti et al, Phys. Rep. 424, 175 (2006). 

[3] J.D. Noh, H. Rieger, Phys. Rev. Lett. 92, 118701 (2004). 

[4] S. Condamin et al, Nature 450, 77 (2007). 

[5] A. Fronczak, P. Fronczak, Phys. Rev. E 80, 016107 (2009). 

[6] D. Gfeller, P. De Los Rios, Phys. Rev. Lett. 99, 038701 

(2007). 
[7] V. Zlatic, A. Gabrielh, G. Caldarelh, larXiv:1003.l883V l. 
[8] J.-C. Delvenne, S. N. Yaliraki, M. Barahona, Proc. Natl. 

Ac. Sc. 107, 29:12755 (2010). 
[9] M. Chavez et al, Phys. Rev. Lett. 104, 118701 (2010). 
[10] L. da Fontoura Costa et al, Appl. Phys. Lett. 91, 054107 

(2007). 

[II] S. Lee, S.-H. Yook, and Y. Kim, Eur. Phys. J. B 68, 
277281 (2009). 

[12] T. M. Cover and J. A. Thomas, Elements of Information 

Theory, Wiley (1991). 
[13] W. Parry, Trans. Amer. Math. Soc. 112, 55-65 (1964). 
[14] L. Demetrius, T. Manke, Physica A 346, 682 (2005). 
[15] J.C. Delvenne and A.S. Libert, arXiv:0710:3972v2. 
[16] Z. Burda, J. Duda, J. M. Luck, and B. Waclaw, Phys. 

Rev. Lett. 102, 160602 (2009). 
[17] J. Gomez-Gardenes, V. Latora, Phys. Rev. E 78, 

065102(R) (2008). 
[18] V. Colizza, R. Pastor-Satorras and A. Vespignani, Nature 

Physics 3, 276 (2007). 
[19] N. Fujiwara, J. Kurths, A. Diaz-Guilera, Phys. Rev. E 

83, 025101(R) (2011). 
[20] P. Bonacich, Jour. Math Soc. 2, 113120 (1972). 
[21] R. Pastor-Satorras, A. Vazquez and A. Vespignani, Phys. 

Rev. Lett. 87, 258701 (2001). 
[22] R. Guimera et al, Phys. Rev. E 68, 065103(R) (2003). 
[23] M.E.J. Newman, Phys. Rev. E 64 016131 (2001). 
[24] M. Boguiia et al, Phys. Rev. E 70, 056122 (2004). 
[^25] For uncorrelated graphs, Uj ~ k{j) [23|, and Ea. (fTO)) 

reduces to Eq.®. 
[26] J. G. Restrepo, E. Ott, and B. R. Hunt, Phys. Rev. E 

76, 056119 (2007). 
[27] See supplementary material for details about the quality 

of the approximations shown in table I. 



SUPPLEMENTARY MATERIAL 



KULLBACK-LEIBLER DIVERGENCE 

In order to test the quality of the approximations of 
different orders we considered the KuUback-Leibler di- 
vergence between the transition matrix tt in Eq. (4) and 
the transition matrices which use only local information. 
Given two discrete distributions P = {pi} and Q = {qt}, 
the KuUback-Leibler divergence Dkl{P\Q), also known 
as the relative entropy of P with respect to Q, is a non- 
symmetric measure of the amount of extra information 
required to represent P by using only information about 
Q. It is defined as the average of the logarithmic distance 
between P and Q, weighted by the probability P: 

Pi 



Dkl{P\Q) = Y.P-^''^2 



Qi 



(11) 



and represents the number of extra bits of information 
required to reconstruct P starting from Q [Sl|. In other 
words, Dkl is the expected log-likelihood to reject a false 
hypothesis Q, per event. In this sense, Dkl measures 
how much P and Q are different. We have computed the 
KuUback-Leibler divergence between the transition ma- 
trix TT in Eq. (4) and the transition matrices tt'^, tt^, tt^, 
TT^ , tt'* corresponding to local approximations of increas- 
ing order. The expressions for tt*^, tt^, tt^ are respectively 
given in Eq. (7), Eq. (6) and Eq. (8), while tt^ and tt'^ are 
defined as follows: 



^'(*lN) 



'^"1 J2i2 aiii2^(*2)fcnn(«2) 



Z^jj 0-iii 2.^,j 



, aiii2^(*2)fcnn(i2) 
^1112 ^i^^z ^\^3 j^nn \^3 ) 



L-iii ^iil L-ii^iz '^ili2 '^2223 "'1*3 j"^rm i*3 



(12) 



13) 



Notice that the choice of transition matrix tt^ guarantees 
that all the walks of length fc-fl are cquiprobable. There- 
fore, the values of D k l{t^\'!^^) measure the inaccuracy in 
using the process tt*^, which makes equiprobable walks 
of length /c -|- 1, with respect to using process tt, which 
makes equiprobable walks of infinite length. In Table HI] 
we report the values of Dii:L(7r|7r''), fc = 0,1,2,3,4, ob- 
tained for the six real networks considered in Table I of 
the main text. 



Dkl{-) 


(-1-^') 


(^k') 


(ttItt^) 


(ttItt^) 


(^k') 


Internet AS 


0.784 


0.163 


0.089 


0.032 


0.031 


US airports 


0.928 


0.176 


0.072 


0.011 


0.001 


E-mail 


0.724 


0.137 


0.045 


0.019 


0.009 


SCN (cond-mat) 


1.796 


0.900 


0.737 


0.576 


0.471 


SCN (astro) 


2.499 


1.167 


0.805 


0.570 


0.417 


PGP 


1.529 


0.729 


0.529 


0.387 


0.282 



TABLE IL KuUback-Leibler divergence between tt and suc- 
cessive approximations tt''" for different real and synthetic net- 
works. 



In the first three networks in the table, Dkl(j^\t^'^) is 
lower than 0.1 bits. For these networks, the entropy rate 
/i(7r^) is about 99% of the maximal entropy rate h{Ti). 
Conversely, for the last three networks, the divergence 
D K l{t^\''^'^) is always approximately 1 bit, and in fact the 
entropy rate /i(7r^) is around 96% of h['K). As expected 
the divergence rapidly decreases as we include walks of 
higher length. 





M... 






Ho * 


0.99 


^^1! 








0.98 


^^ 


ftfl 






0.97 




V* ^-^ 


-^■■■ 




0.96 
0.95 




\. 


X 


^-^^. 


0.94 








\ N] 


0.93 








x^ 


0.92 








\^ 


0.91 








\, 



0.05 0.1 0.15 0.2 0.25 

% of defects 



FIG. 2. Ratio of the entropy rate of approximations tt" (red 
plus), TT^ (black squares) and vr^ (blue squares) over the en- 
tropy rate of a maximal-entropy random walk tt, as a function 
of the percentage of links removed in lattices with defects, as 
explained in the text. 



LATTICES WITH DEFECTS 

We have also studied approximations 7r°, tt^ and tt^ 
of the maximal-entropy random walk on lattices with 
some irregularities as in Ref. |S2l |. The networks are 
constructed by removing at random a small fraction of 
nonadjacent links from an L x L square lattice with peri- 
odic boundary conditions. In this way we obtain a dam- 
aged lattice with a weak disorder (dilution) , where most 
of the nodes are of degree A; = 4 and some of degree 
A: = 3. The removal of links at random from a regular 
lattice destroys the perfect degree regularity and intro- 
duces degree-degree correlations. In Fig. [2]we report the 
ratio between the entropy rate of the approximations tt", 
TT^ and TT^, and the entropy rate of tt, as a function of the 
dainage inflicted to the network. Notice that, even when 
10% of links have been removed (as in Ref. [S2|), the ap- 



proximation TT^ gives an error smaller than 2%. These 
numerical results confirm that local approximations pro- 
vide good estimates of the maximal entropy rate also in 
lattices with defects. 
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